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Abstract. Neutrino oscillations depend on the neutrino mass spectrum. The expected 
difference between normal and inverted hierarchy is about 30% for muon neutrinos of 
6-8 GeV that propagate for 6000-8000 km in the Earth. These requirements point to 
very long baseline neutrino experiments from CERN to Baikal Lake or from Fermilab 
to KM3NET (or to ANTARES) with conventional pion beams. Collecting 10^° protons 
on target, one finds about a thousand events in a detector of 1 Mton, which makes 
it possible to observe the desired difference. The signal events are well characterized 
experimentally by their time and direction of arrival, and 2/3 of them are in a region 
with little atmospheric neutrino background, namely, between 4 GeV and 10 GeV. This 
can guarantee the identification of the neutrino mass spectrum just counting muon tracks. 



1. Introduction 

The study of neutrinos from the sun [1], from the Earth's atmosphere [2j and from arti- 
ficial sources p] led to discover neutrino oscillations [Ij proving the relevance of the matter 
(MSW) effect [5] for solar neutrinos. The most direct extension of the standard model 
requires 3 massive neutrinos. Such a picture, summarized in Fig. [T] following [6j, permits 
us to account for most neutrino observations and to ask new questions; in particular, how 
to probe whether the neutrino spectrum is normal or inverted. After the experimental 
evidence that ^13 is large [7| a more precise formulation of this question is: how to take 
advantage of the matter effect in the Earth to solve this ambiguity. 

The most relevant energies are indicated directly by the theory: the matter effect is 
maximum when the matter and the vacuum term that describe oscillations are comparable, 
and this happens when the neutrino energies are in the range 5 — 10 GeV. Moreover, 
neutrinos have to cross a sizeable amount of matter, of the order of the Earth's radius, as 
discussed later on (Sect. [2] and appendix [A|) and in agreement with the 'oscillograms' of [8] 
or with Fig. 3 of [S]. 

However, it is not easy to collect an adequate experimental sample of events where the 
matter effect is large [TOJ. An idea is to use atmospheric neutrinos, and more precisely, 
muon neutrinos and antineutrinos, because the easiest particles to detect are the muons 
and the antimuons. Several specific options have been considered, however all of them 
require a very large detector mass, due to the strong decrease of the atmospheric neutrino 
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Figure 1. The two spectra that are compatible with present neutrino data: 
left, normal hierachy; right, inverted hierarchy. The flavor content of each 
individual state with given mass, \Ufj\, is represented using a color code. 



flux with energy|J Moreover, it is not possible to reconstruct the neutrino energies and 
directions simply observing the muons; in fact, a muon neutrino with energy E will give 
a muon with energies from zero to this value, and the angle between the neutrino and the 
produced muon is ~ a/1 GeV/E ~ several tens of degrees. 

With these considerations in mind, we would like to suggest a different approach to 
emphasize the physics effect we are interested, insisting on the use of large muon detectors. 
We propose to send a muon neutrino beam produced in laboratory, with energies and at 
a distance chosen to maximize the matter effect. In other terms, we suggest that in order 
to distiguish normal from inverted hierarchy, we should simply count muons in the right 
type of experimental setup. 

2. Muon survival probability 

We begin from the case when only the largest Am? matters. If ^13 is set to zero, we 
have 2-flavor vacuum oscillation: the muon survival probability oscillates as a function 
of the energy, its maxima correspond to the minima of P^jt (and viceversa), and there is 
no difference between normal and inverted hierarchy. Then, let us consider the effect of 
^13. Assuming normal hierarchy, P^g is amplified due to matter effect for certain energies. 
Therefore, the muon survival probability, 

(1) -^MA* — ^ Pfie -f/xT 

must decrease. Instead, for inverted hierarchy P^e is suppressed by matter effect and the 
oscillations are very similar to the case when ^13 is set to zero. 

Being interested in maximizing the difference between normal and inverted hierarchy, 
we consider the case when a local maximum of P^^ is decreased as much as possible. This 
happens when the first minimum of P^r, that drives the maximum of Pf_in, falls close to 

^E.g., a 50 kton magnetized iron detector, able to measure the charge of the muon [11] and to distinguish 
between neutrinos and antineutrinos; many 100 kton argon detectors, able to measure also the energy of 
the hadrons scattered by the neutrinos, reconstructing better the neutrino energy [T^; a huge, ~ 10 Mton 
water Cherenkov muon detector [8], as a dense core of underwater/underice installations aimed at seeing 
high-energy neutrinos from cosmic sources. 
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Figure 2. Oscillation probabilities for L = 7000 km: the continuous (black) line is P^^; 
the dashed (red) line P^e; the dotted (cyan) line P^t- Left /right panel, normal/inverted 
hierarchy. The increase of P^e for normal hierarchy, due to matter effect, causes the 
decrease of Pan- 



the energy where P^^ is large. Such a condition can be analyzed easily and efficiently using 
the web resource, 

http : //pcbatl .mi . infn. it/~battist/cgi-biii/oscil/ index . r' 

A FORTRAN code, developed for the study jT2] where it is described, integrates numeri- 
cally the hamiltonian for neutrino oscillations in the Earth with an accuracy of better than 
1 part per million. Let us adopt the result of the global analysis of the Bari group jTB] , 
namely, 6*12 = 33.6°, ^ = 8.9/9.0°, 6*23 = 38.4/38.8°, 5 = 194/196°, Am?2 = 7-54 x 10"^ 
eV^, Am23 = 2.39/2.47 x 10~^ eV^; where the two values apply to normal/inverted hier- 
archy, respectively. When the neutrino energy E and the corresponding oscillation length 
L are about 

(2) S = 6, 7, 8 GeV and L = 6000, 7000, 8000 km respectively 
we have that 

(3) ^rr(NH) ~ 0.7 

Therefore, the difference with P^"^(IH) ~ 1, in the case of inverted hierarchy, is as large 
as 30% for the distances given above, L ~ R^. As an example, we plot in Fig. [2] the case 
L = 7000 km. 

We verified that for other distances and/or other energies, the effect is smaller, especially 
when L decreases. Thus the above conditions identify the optimal distances and energies 
to search for matter effect on P^^j., and impose conditions on the type of muon neutrino 
source and muon detectors needed for this purpose. We checked that these results do not 
depend much on the errors on most of the parameters, and in particular on CP- violating 
phase. The largest variation is due to ^23; for instance, the 3ct range [13j implies that at 
7800 km P"^"^'(NH) ~ 0.7^g5'5, that is not a very wide variation, and moreover, there are 
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Figure 3. Various Uf_iN fiX cross sections as a function of the energy of the incoming 
j/^. The continuous (black) line is the total cross section; the dashed (red) line restricts 
the muon energy to 2 < iS^ < 12 GeV; the dotted (green) to 4 < iJ^ < 6 GeV. 



reasonable perspectives that 623 will improve in the next few years. Appendix [A] o ffers 
further discussion of the matter effect enriched by analytical formulae (e.g., Eqs. |10| and 



17 show that the effect increases with sin^ ^23)- 

3. Cross section for neutrino-muon production 
For the energies of interest, the leading interaction that yields observable muons is, 
(4) u,, + N^n-+X 

where is an average nucleon and A is a set of hadrons; we consider water nuclei, therefore 
a neutron/proton ratio of 4/5. We use the differential cross section da/dE^ calculated in 



following [15]. In view of the fact that the neutrino energies are not very large, we 
sum the following three contributions according to the hadronic mass of the final state 



(1) The quasi-elastic contribution, with M| = 0.95 GeV^ and Fa(0) = -1.26 [Mj. 

(2) The delta resonance, where we resort to CVC and PCAC and the parameterization 
of the form factors described in eqs. 12, 13 and 18 of [T7| . 

(3) The deep inelastic contribution for mx > 1-4 GeV, with GRV94 partons |18j . 

We show in Fig. [3] the following integrated cross sections: 1) the total cross section; 2) the 
one where we integrate only the region of muon energy 2 < < 12 GeV; 3) the same, 
restricted to the range 4 < i?^ < 6 GeV. As customary after [15], also the ratio between the 
cross section and the neutrino energy is given. At these energies, we find an approximate 
scaling of the integrated cross section: a{Ei^,Ei < E^ < E2) = J^^ -^{E^^E^) dE^ 
f{Ey — Ei,E2 — El). Note that when Ei, is close to the threshold, the contribution of 
individual resonances considered (the nucleon and the delta) is clearly visible. 

4. Needs for the experiment 



4.1. Mass of the detector. In order to have a reasonable event counting rate, we note 
that the number of muon events scales with the mass of the detector M^^t and the distance 
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L as oc Mdot/i^- Thus, we have approximatively as many events in a detector of 
10 kton at 800 km from the source (roughly corresponding to the present generation long 
baseline experiment NOz^A [19]) and in a detector of 1 Mton located at 8000 km. Moreover, 
we need to detect muons from few to ten GeV (see Fig. [2]) which means that we have to 
measure tracks of 10 — 40 meters in water. 

These requirements, concerning the mass of the detector and the length of the tracks 
to be revealed, point toward a large but relatively simple underwater or under-ice de- 
tector, that could resemble the PINGU [20] and ORCA [21] proposals that are being 
developed/considered by the IceCube and KM3NET collaborations, respectively. In the 
following, we will assume that the detector has a number of useful target nucleons of 

(5) iVtarg. = 6 X 10^5 

corresponding to a cube of water of 100 m in size, i.e., M^et = 1 Mton, and leave a more 
detailed description of the detector for future work. Our results can be simply rescaled 
with the mass of the detector. 

4.2. Source-detector distance. The next question is which arrangment of source and 
detector would fit the optimal distance identified above. Let us consider the existing 
neutrino lines p2] and a few sites of under-water and under-ice neutrino experiments. 
Their approximate coordinates in degrees are 

( (+41.8, -88.3) Fermilab ( (-90, +0.0) South Pole 

(6) {\^(j)) = l (+46.2, +6.0) CERN and = < (+36.3, +16.1) Sicily 

\ (+36.4, +140.6) J-PARC \ (+51.8, +104.3) Baikal Lake 

'South Pole', 'Sicily' and 'Baikal Lake' correspond to the coordinates of IceCube, KM3NET 
and GVD, respectively. From the position versors fti = (cos Aj cos 0i, cos Aj sin sin Ai) we 
find the relative distances as L = -Re|ni — n2\ = R^\/2{1 — ni ■ n2); or, using the web 
resource [23] one gets the minimum distance on the Earth surface A (the arc) and thus 
L = 2i?0 sin[A/(2i?0)]. We find the following distances, expressed in km 





Fermilab 


CERN 


J-PARC 


South Pole 


11600 


11800 


11400 


Sicily 


7800 


1230 


9100 


Baikal Lake 


8700 


6300 


3300 



The pairs CERN to Baikal Lake and Fermilab to Sicily are at an optimal distances. The 
first case would be somewhat more convenient, for its 1/L^ factor is 50% larger. However, 
as we will show, also the second case offers reasonable opportunities for an experiment, and 
before continuing, we note that also the location of ANTARES, with (A, (p) = (+42.8, +6.2), 
would be favourable, its distance from Fermilab being 6900 km. 

4.3. Properties of the neutrino beam. The existing neutrino beam from CERN has a 
mean energy twice than necessary to probe the matter effect, whereas it has already been 
shown that the NuMI neutrino beam can be arranged to fit our needs [21]. The estimated 
fluences, and more precisely those called HE and ME options [23], are evaluated for lO^'' 
protons on target and at 1.04 km from the source. They can be reasonably approximated as 
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Figure 4. Differential neutrino fluences for a distance of L = 7800 km. The two dashed 
gaussian distributions at the right and at the left are quite similar to the fluxes ME and 
HE estimated in [2^ for lO'^" protons-on-target, shown as histograms. The black gauss- 
ian distribution with intermediate energies is assumed for the subsequent calculations. 
Compare with Fig. |2] 




gaussian distributions, proportional to G{E,E,5E) = exp[— (£■ — E)"^ /{25E'^)]/V2tt~6E^, 
with E = 8.2 (resp., 5.3) GeV and 5E = 2.8 (resp., 1.6) GeV as shown in Fig. ffl where we 
rescaled for a distance of L = 7800 km. The fluence of a conventional muon neutrino beam, 
with properties intermediate between the above two cases (see Fig.|4]), again corresponding 
to lO^'' protons on target and at the same distance, is approximated by 

(7) ^ = l^y,G{E,E,6E) with 
dE cm^ 

In the following, we will consider such a fluence for definiteness. 

5. Results 

The number of expected muon tracks contained in the detector, corresponding to muon 
energies larger than Eth and to a given fluence of muon neutrinos d^/dE, is 

(8) A^;. = iVtarg. X / P^^{E) x^{E)x a{E) dE 

When we use the number of targets as in Eq. [sj the fluence of Eq. [T] (see previous section) 
and the cross section to produce muons above 2 GeV and below 12 GeV (Sect, pi) we get 



(9) N, 



950 with normal hierarchy 
1300 with inverted hierarchy 

the difference is 30%, as expected. The distribution of the events is shown in Fig. [sj Even 
if we retain only the events with muon energy above 4 GeV, in order to avoid confusion 
with atmospheric neutrinos, we loose only 1/3 of the events. The number of signals is 
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Figure 5. Left panel, distribution in the neutrino energy; the continuous curve (red) 
is for normal hierarchy, the dashed one (green) is for inverted hierarchy. Right panel, 
comparison of the number of events in various windows of muon energy (2-4 GeV, 4-6 
GeV, etc., as indicated below the abscissa) for normal hierarchy (left bars in the back, 
red) and for inverted hierarchy (right bars in front, green). 



large; the difference between normal and inverted hierarchy cannot be mimicked by any 
plausible statistical ffuctuation. The signal events can be distinguished by those from 
atmospheric neutrinos not only because of their spectra, but also thanks to a certain 
degree of directionality at these energies, and, most of all, because the neutrinos arrive in 
bunches, due to the pulsed structure of the artificial neutrino beam. 



6. Summary and discussion 

It is widely recognized that the identification of the neutrino mass spectrum is one of 
the most important goals of future experimental investigations. The matter effect [5] in 
the Earth offers a clear way to achieve it. In this work, we argued that the ideal conditions 
are obtained for muon neutrinos with energies of 6 — 8 GeV propagating in the Earth for 
a distance of L = 6000 — 8000 km that correspond to various useful possibilities. We have 
shown in the previous section that a (water Cherenkov) muon detector of 1 Mton along 
with a conventional muon neutrino beam resulting from 10^*^ protons on target leads to a 
large signal of about 1000 signal events that are well characterized experimentally, even at 
the maximum distance considered above (i.e., 7800 km). The signal is composed by muons 
between 2 — 10 GeV that can be identified as 10 — 40 m long tracks, with 2/3 of them above 
4 GeV. Due to the matter effect, the inverted hierarchy yields 30% more events than the 
normal hierarchy case. Thus, the difference induced by the matter effect is quite large and 
even a moderate understanding of the artificial neutrino beam should suffice to identify 
experimentally which is the neutrino mass spectrum. 
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Appendix A. Remarks on the matter effect 

We would like to comment on the conclusions of Sect. [2] by examining the simple case 
of oscillations in constant matter density. With normal hierarchy, the probability that a 
muon converts into an electron is, 

2/1 1 1 ~ ^ ~ Am^L 

(10) P^e = sin 6'23 sin 26'i3 sin Ip with (/? = — — - — 

We introduced the usual matter-modified mixing angle and squared-mass-difference 

sin 2^ = sin 26^13 /A 

(11) < cos20i3 = (cos 26*13 - e) /A where A = ± (cos 26*13 - + sin^ 26*13 

Am^ = Am^ x A 

where the sign of A is arbitrary and irrelevant, and the ratio between matter and vacuum 
term is, 

^Gpue p Y2 2.4xlO-3eV2 E 



Am2/(2S) 5.5 g/cm3 1/2 Am^ 5.5 GeV 

As usual Gi? is the Fermi coupling and we identify Am^ with /\m\.^. Considering the 
average matter density of the Earth p = 5.5 g/cm^ and = 1/2, we get Ue = 1.7 x 10^'* 
e~/cm^ for the electronic density. Thus, the characteristic length of MSW theory is, 

(13) = 1000 km 

V2Girne 

We see that the maximum of P^e (for normal hierarchy) is obtained when A is as small as 
possible and the phase of propagation is 7r/2, i.e., when the neutrino energy and propagation 
distance are, 

Attz^Tj 7tL 

(14) S^ax = ^ COS 2^13 ~ 5.5 GeV and L„,ax = , * ~ 9000 km 

2 tan 26*13 

In the case of inverted hierarchy, the matter effect depresses P^ej that becomes negligible. 

In principle, one could check this simple prediction concerning P^e-, however it is prac- 
tically easier to study muons rather than electrons. Then, let us consider the survival 
probability P^^- We want that a local maximum of P^^, resulting from P^r and from 
P^e, is as small as possible; thus, we are interested in the case when the minimum of P^t 
happens in the vicinity of the energy identified in Eq. [141 When the phase of oscillation of 
P^T is close to the vacuum phase, the condition Am2L/(4£'max) = tt gives L ~ 6000 km. 
Thus, we conclude that the distance that amplifies the matter effect on P^^ is between 
6000 and 9000 km, that supports the conclusions of the numerical analysis of Sect. [2| 
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Finally, we collect further technical remarks and additional clarifications concerning 
the matter effect. Let us write in full generality the amplitude of three flavor neutrino 
oscillations 



(15) 



A = Texp 




where aij depend upon Amgs, 6*13, Amfg) ^12 1 and H = ±.1 (the type of mass hierarchy, 
normal/inverted): see in particular Eqs. 1, 3, 5, 6 of (I2] . When the "solar" Amf2 is 
set to zero-i.e., when its effects are negligible-the only non-zero out-of-diagonal element 
are ai3 and 031. The probability Pui = \Ae,ii\'^ becomes symmetric, Put = P^'£ for each 
^' = e, /i, r; therefore, we have 3 independent probabilities and all the other ones are 
fixed. We can chose, e.g.. 



sin^ 6*231013^, 



Per = COS^ 6*2310131^, Pfir = siu^ 6*23 COS^ 6*23! 033 " 022p, 

|aiip. In the case of constant matter density considered 



(16) 

so that, e.g., Pee = l-PAte-P-i 
above, the explicit solution for normal mass hierarchy reads simply: 

ai3 = 031 = —i sin ^sin 2^13 

~ "^33 



(17) 



an 
022 



where 
(18) 



cos if + i sin ip cos 2^13 
cos ^' + i sin ^' 



il + e) 



Changing the sign of e, one obtains the probability of oscillation of antineutrinos for normal 
hierarchy; in the approximation we are considering in this appendix, this coincides with 
the probability of oscillation of neutrinos for inverted hierarchy. 

Eq. 10 follows from the first two equations of Eqs. 16 and 17 Then, we discuss P^r close 
to its first minimum, that occurs for the energies where the matter effect is large. Writing 

P., = sin2 2023| 1- V 



(19) 

we see that even the relatively small Pee ~ 0.3 



eexp(i(^) 1^/4 

0.4, due to matter effect, will not lift 
much P^jT- from zero near the minimum, close to the point ^ = 2tt. The phase (p, defined by 
V Pee cos = cos ^ cos ^' — sin sin ^' COS 2^13 , can be close to the vacuum phase: in fact, 
if £ is large or small in comparison to 1, then cos20i3 ~ +1 and ip ~ /S.m? L / {AE){1 — e), 
so that (p if + ip' Am^L/(2£'). 
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